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A  Meta-Analysis  of  Factors  Affecting 
Trust  in  Human-Robot  Interaction 

Peter  A.  Hancock,  Deborah  R.  Billings,  and  Kristin  E.  Schaefer,  University 
of  Central  Florida,  Jessie  Y.  C.  Chen,  U.S.  Army  Research  Laboratory,  and 
Ewart  J.  de  Visser,  and  Raja  Parasuraman,  George  Mason  University 


Objective:  We  evaluate  and  quantify  the  effects  of 
human,  robot,  and  environmental  factors  on  perceived 
trust  in  human-robot  interaction  (HRI). 

Background:  To  date,  reviews  of  trust  in  HRI 
have  been  qualitative  or  descriptive.  Our  quantitative 
review  provides  a  fundamental  empirical  foundation  to 
advance  both  theory  and  practice. 

Method:  Meta-analytic  methods  were  applied  to 
the  available  literature  on  trust  and  HRI.  A  total  of 
29  empirical  studies  were  collected,  of  which  10  met 
the  selection  criteria  for  correlational  analysis  and 
I  I  for  experimental  analysis.  These  studies  provided 
69  correlational  and  47  experimental  effect  sizes. 

Results:  The  overall  correlational  effect  size  for  trust 
was  r  =  +0.26,  with  an  experimental  effect  size  of  d  =  +0.7 1 . 
The  effects  of  human,  robot,  and  environmental  charac¬ 
teristics  were  examined  with  an  especial  evaluation  of 
the  robot  dimensions  of  performance  and  attribute-based 
factors.  The  robot  performance  and  attributes  were 
the  largest  contributors  to  the  development  of  trust  in 
HRI.  Environmental  factors  played  only  a  moderate  role. 

Conclusion:  Factors  related  to  the  robot  itself, 
specifically,  its  performance,  had  the  greatest  current 
association  with  trust,  and  environmental  factors  were 
moderately  associated.  There  was  little  evidence  for 
effects  of  human-related  factors. 

Application:  The  findings  provide  quantitative 
estimates  of  human,  robot,  and  environmental  factors 
influencing  HRI  trust.  Specifically,  the  current  summary 
provides  effect  size  estimates  that  are  useful  in 
establishing  design  and  training  guidelines  with  reference 
to  robot-related  factors  of  HRI  trust.  Furthermore, 
results  indicate  that  improper  trust  calibration  may  be 
mitigated  by  the  manipulation  of  robot  design.  However, 
many  future  research  needs  are  identified. 

Keywords:  trust,  trust  development,  robotics,  human- 
robot  team 
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INTRODUCTION 
Human-Robot  Partnerships 

Robots  are  frequently  used  in  environments 
that  are  unreachable  by  or  are  unsafe  for  human 
beings.  Robotic  operations  include,  among 
others,  planetary  exploration,  search  and  res¬ 
cue,  activities  that  impose  hazardous  levels 
of  workload  on  human  operators,  and  actions 
requiring  complex  tactical  skills  and  informa¬ 
tion  integration  (Hinds,  Roberts,  &  Jones,  2004; 
Parasuraman,  Cosenzo,  &  de  Visser,  2009). 
Robotic  usage  is  penetrating  into  many  diverse 
applicational  realms,  especially  in  the  advanced 
surgical  areas  and  as  assistive  technologies 
for  injured  and  disabled  persons  (Guizzo  & 
Goldstein,  2005 ;  Heerinlc,  Krose,  Evers,  &  Wielinga, 
2010;  Tsui  &  Yanco,  2007).  When  they  are  used  in 
military  operations,  robots  are  often  currently 
perceived  as  tools  to  be  manipulated  by  humans 
to  accomplish  specific  discrete  functions  (Chen, 
Bames,  &  Harper-Sciarini,  2010). 

Yet,  as  robot  capabilities  grow,  the  possibility 
arises  that  they  might  provide  higher  level  func¬ 
tions  as  full-fledged  team  members.  For  this 
higher  functioning  to  blossom,  however,  effective 
human-robot  partnerships  will  need  to  be  forged 
to  ensure  success  in  dangerous  conflict  situations, 
particularly  because  of  the  increased  stress  and 
cognitive  workload  demands  placed  on  contem¬ 
porary  warfighters  (Hancock  &  Warm,  1989). 

In  future  military  contexts,  warfighters  are 
likely  to  be  mandated  to  interact  with  a  diverse 
inventory  of  robots  on  a  regular  basis,  particularly 
in  dynamic  and  stressful  enviromnents  (Chen  & 
Terrence,  2009).  Already,  robotic  systems  have 
demonstrated  their  usefulness  in  decision  mak¬ 
ing,  communication,  enhancement  of  warfighter 
situation  awareness,  combat  efficiency,  and  reduc¬ 
ing  uncertainty  in  volatile  situations  (Adams, 
Bruyn,  Houde,  &  Angelopoulos,  2003).  However, 
the  assumption  that  introducing  robots  into 
human  teams  will  result  in  better  performance,  as 
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compared  with  when  the  team  or  robot  operates 
independently,  may  not  always  be  justified. 
Although  the  addition  of  robotic  systems  may 
lead  to  improved  team  capabilities,  it  may  also 
create  difficult  challenges  that  need  to  be  over¬ 
come  before  such  hybrid  partnerships  can  work 
more  effectively  (Adams  et  al.,  2003). 

Research  continues  to  address  such  chal¬ 
lenges  as  creating  and  validating  metrics  for  the 
evaluation  of  a  wide  spectrum  of  human-robot 
interactions  (HRI)  issues  (Steinfeld  et  al.,  2006); 
designing  human-robot  interfaces  to  facilitate 
interaction,  operator  understanding,  and  situa¬ 
tion  awareness  (Chen  et  al.,  2010;  Chen,  Haas,  & 
Bames,  2007;  Keyes,  Micire,  Drury,  &  Yanco, 
2010);  translating  qualities  of  good  human 
teammates  into  features  of  the  robot;  and 
encouraging  human  trust  in  robots  (Groom  & 
Nass,  2007),  which  is  perhaps  foremost  among 
these  challenges. 

Human-Robot  Trust 

For  a  human-robot  team  to  accomplish  its 
goal,  humans  must  trust  that  a  robotic  team¬ 
mate  will  protect  the  interests  and  welfare  of 
every  other  individual  on  the  team.  The  level  of 
trust  in  any  robotic  partner  will  be  particularly 
critical  in  high-risk  situations,  such  as  combat 
missions  (Groom  &  Nass,  2007).  Trust  is  impor¬ 
tant  in  these  contexts  because  it  directly  affects  the 
willingness  of  people  to  accept  robot-produced 
information,  follow  robots’  suggestions,  and  thus 
benefit  from  the  advantages  inherent  in  robotic 
systems  (Freedy,  de  Visser,  Weltman,  &  Coeyman, 
2007).  Trust  therefore  very  much  affects  the  deci¬ 
sions  that  humans  make  in  uncertain  or  risky 
enviromnents  (Park,  Jenkins,  &  Jiang,  2008).  For 
example,  the  less  an  individual  trusts  a  robot,  the 
sooner  he  or  she  will  intervene  as  it  progresses 
toward  taskcompletion  (de  Visser,  Parasuraman, 
Freedy,  Freedy,  &  Weltman,  2006;  Steinfeld 
et  al.,  2006). 

However,  some  accounts  from  warfighters  in 
the  field  demonstrate  the  ease  with  which  trust 
can  actually  develop  between  robots  and  humans 
in  stressful  operations.  In  fact,  one  Explosive 
Ordnance  Disposal  unit  named  its  robot  Sgt.  Talon 
and  gave  it  promotions  and  even  Purple  Hearts  for 
its  stellar  bomb  disposal  performance  (Garreau, 
2007).  Other  accounts  by  soldiers,  in  contrast, 


illustrate  the  difficulties  in  trusting  robots  in  these 
situations.  For  instance,  the  SWORD  (Special 
Weapons  Observation  Reconnaissance  Detection) 
system  was  developed  and  deployed  in  Iraq  in 
2007  to  support  combat  operations  (Ogreten, 
Lackey,  &  Nicholson,  2010).  SWORD,  although 
fully  operational,  was  never  used  in  the  field 
because  soldiers  did  not  trust  it  to  function 
appropriately  and  safely  in  dangerous  situations 
because  of  unexpected  movements  caused  by 
technological  malfunctions  (Ogreten  et  al,  2010). 

As  illustrated  by  these  respective  accounts, 
varying  levels  of  trust  in  robots  currently  exist 
across  the  HRI  domain.  Inappropriate  levels  of 
trust  may  have  negative  consequences,  such  as 
overreliance  on  and  misuse  of  the  system  (in 
cases  of  extremely  high  levels  of  trust)  or  dis¬ 
use  of  the  system  entirely  (in  cases  of  very  low 
levels  of  trust)  (Lee  &  See,  2004;  Parasuraman 
&  Manzey,  2010;  Parasuraman  &  Riley,  1997). 
Both  distrust  and  overreliance  can  undermine 
the  value  of  the  HRI  system.  Trust  also  influ¬ 
ences  neglect  tolerance,  which  is  defined  as  the 
decline  in  semiautonomous  robot  performance 
as  human  attention  is  directed  to  other  tasks  and/ 
or  as  the  task  complexity  increases  (Goodrich, 
Crandall,  &  Stimpson,  2003). 

When  an  individual  places  a  large  amount  of 
trust  in  a  robot  and  does  not  feel  compelled  to 
actively  manage  it,  he  or  she  may  ignore  the 
robot  for  long  periods.  Consequently,  neglect 
tolerance  should  be  appropriately  calibrated  to 
the  capabilities  of  the  robot  and  the  level  of 
human-robot  trust.  Too  much  neglect  can  make 
it  difficult  for  the  individual  to  regain  situation 
awareness  after  redirecting  attention  back 
toward  the  robot.  Too  little  neglect  means  the 
human  operator  is  not  attending  to  his  or  her 
own  personal  tasks,  thus  resulting  in  suboptimal 
system  performance  overall. 

Current  Research 

Trust  in  HRI  is  very  much  related  to  trust  in 
automation  in  general,  which  has  been  studied 
with  respect  to  its  various  performance  influences 
(Chen  et  al.,  20 1 0;  Lee  &  See,  2004;  Parasuraman, 
Sheridan,  &  Wickens,  2008;  Sheridan,  2002). 
Robots  differ  from  most  other  automated  sys¬ 
tems  in  that  they  are  mobile,  are  sometimes  built 
in  a  fashion  that  approximates  human  or  animal 
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form,  and  are  often  designed  to  effect  action  at  a 
distance.  Such  differences  could  suggest  that 
human  trust  may  differ  for  robots  versus  other 
forms  of  automation,  although  this  difference 
would  need  to  be  demonstrated  empirically,  and 
few  if  any  such  direct  comparisons  have  been 
conducted  to  date. 

Alternatively,  one  can  begin  with  the  view  that 
human-robot  trust  and  human-automation  trust 
share  similar  fundamental  characteristics  but  allow 
for  the  possibility  for  differences  as  new  evidence 
is  obtained.  Certainly  the  literature  on  human- 
automation  trust  provides  a  fertile  ground  for 
understanding  a  number  of  factors  influencing 
how  humans  trust  other  external  agents.  The 
human-robot  trust  literature  is  more  restricted, 
but  nevertheless,  sufficient  numbers  of  empiri¬ 
cal  studies  have  been  conducted  to  warrant  a 
meta-analysis  to  identify  the  major  factors  cur¬ 
rently  involved. 

Trust  can  be  dynamically  influenced  by  fac¬ 
tors  (or  antecedents)  within  the  robotic  system 
itself,  the  surrounding  operational  environment, 
and  the  nature  and  characteristics  of  the  respec¬ 
tive  human  team  members  (Park  et  al.,  2008). 
Each  of  these  factors  can  play  an  important  role 
in  trust  development.  To  date,  reviews  of  trust  in 
HRI  have  been  qualitative  and  descriptive,  and 
existing  experiments  largely  attempt  to  extrapo¬ 
late  the  optimum  degree  of  trust  for  a  given  out¬ 
come  (e.g.,  team  performance,  reliance  on  the 
robot).  In  doing  so,  a  degree  of  inappropriate 
trust  (i.e.,  excessive  trust  or  too  little  trust)  is 
also  identified  for  each  potential  outcome  of 
HRI,  such  as  over-  or  underreliance  and  poor 
team  collaboration.  The  factors  that  affect  the 
process  by  which  trust  develops  in  any  HRI  sit¬ 
uation  also  need  to  be  considered.  However,  to 
date,  the  existing  body  of  knowledge  has  mostly 
looked  at  the  momentary  state  of  trust  and  not  its 
process  of  development  per  se.  This  latter  evolu¬ 
tion  clearly  awaits  further  investigation. 

Given  the  foregoing  observations,  the  goal  of 
the  current  research  was  to  perform  a  comprehen¬ 
sive  objective  and  quantitative  review  of  identi¬ 
fied  antecedents  of  trust  in  human-robot  teams. 
Meta-analytic  methods  were  applied  to  the 
extant  literature  on  trust  and  HRI  with  the  aim 
of  quantifying  the  effects  of  differing  dimen¬ 
sions  on  human-robot  trust.  Determining  their 


relative  impact  on  trust  will  not  only  provide  an 
indication  of  current  trends  in  the  human-robot 
trust  research,  but  will  also  lead  to  the  identifica¬ 
tion  of  areas  critical  for  future  study.  Consequently, 
our  quantitative  review  contributes  an  empirical 
foundation  upon  which  to  advance  both  theory 
and  practice. 

ANALYTICAL  METHOD 
Sample  of  Studies 

A  literature  search  was  conducted  using  library 
databases  (including  PsycINFO,  PsycARTICLES, 
PsycBOOKS,  ACM  Digital  Library,  Applied 
Science  and  Technology,  IEEE,  ScienceDirect, 
and  ProQuest  Dissertations  and  Theses).  U.S. 
Army  Research  Laboratory  technical  reports 
were  also  examined  for  relevance.  In  addition, 
we  used  a  number  of  web-based  search  engines, 
for  example,  Google  and  its  derivative  Google 
Scholar,  to  seek  further  references  not  discovered 
by  the  initial  formal  scan.  The  primary  search 
terms  included  human-robot  interaction,  robot, 
and  trust.  After  the  initial  listing  of  articles  was 
obtained,  reference  lists  were  checked  to  deter¬ 
mine  whether  any  other  related  studies  could  be 
included.  In  a  concurrent  process,  subject  matter 
experts  (SMEs)  were  consulted  for  reference 
to  articles  that  had  not  been  identified  by  the 
prior,  fonnal  search  procedure.  SMEs  were  drawn 
from  military,  industry,  and  academia  on  the 
basis  of  their  willingness  to  participate  and  their 
availability. 

Following  this  initial  procedure,  we  examined 
the  collected  literature  and  identified  potential 
factors  associated  with  the  development  of  trust. 
SMEs  also  provided  guidance  in  identifying  fac¬ 
tors  influencing  trust  in  human-robot  relation¬ 
ships.  On  the  basis  of  these  identified  factors,  we 
conducted  specific  searches  in  the  aforemen¬ 
tioned  databases  using  the  primary  search  terms 
robot  and  trust  combined  with  these  secondary 
terms:  prior  experience,  attentional  capacity, 
expertise,  competency,  personality,  attitudes, 
propensity  to  trust,  self-confidence,  false  alarm, 
failure  rate,  automation,  anthropomorphism,  pre¬ 
dictability,  proximity,  robot  personality,  multi¬ 
tasking,  workload,  task  load,  culture,  shared 
mental  models,  and  situation  awareness.  When 
these  elicitation  processes  no  longer  yielded 
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new  citations,  we  compiled  the  final  listing  of 
articles.  This  process  resulted  in  29  empirical 
articles,  reports,  dissertations,  and  conference 
proceedings  published  between  1996  and  2010. 
Of  these,  1 0  papers  containing  69  correlational 
effect  sizes  and  1 1  papers  containing  47  experi¬ 
mental  effect  sizes  met  selection  criteria  for 
inclusion. 

Criteria  for  Study  Inclusion 

All  studies  were  inspected  to  ensure  that  they 
fulfilled  the  following  four  criteria  for  inclusion 
in  the  meta-analysis:  (a)  Each  study  had  to  report 
an  empirical  examination  of  trust  in  which  trust 
was  a  directly  measured  outcome  of  an  exper¬ 
imental  manipulation.  Studies  in  which  trust 
served  as  the  experimental  manipulation  were 
excluded,  (b)  The  empirical  examination  of  trust 
was  directed  toward  a  robot.  Thus,  for  instance, 
studies  on  human-automation  trust  focusing  on  a 
decision  aid  were  excluded  because  the  empha¬ 
sis  of  such  research  is  on  the  decision  aid  and  not 
a  robot,  which  as  discussed  earlier  can  differ  in 
many  ways  from  automated  systems  in  terms  of 
such  factors  as  mobility,  sensor  and  effector  capa¬ 
bilities,  and  so  on.  (c)  The  study  had  to  incorpo¬ 
rate  human  participants  who  either  viewed  or 
participated  directly  in  interactions  with  a  robot 
through  physical,  virtual,  or  augmented  means, 
(d)  Each  study  had  to  include  sufficient  infor¬ 
mation  to  determine  effect  size  estimates. 

Papers  and  literature  meeting  these  criteria 
are  identified  in  the  reference  listing  in  the  pres¬ 
ent  article  by  an  asterisk  appearing  in  front  of 
the  first  author’s  name  (American  Psychological 
Association,  2001).  It  is  important  to  note  that 
rejecting  primary  studies  in  a  meta-analysis  is  a 
common  occurrence  and  is  necessary  to  ensure 
meaningful  results  when  combining  effect  sizes 
across  studies. 

Identification  of  Possible 
Antecedents  of  Trust 

Studies  included  in  the  meta-analysis  were 
classified  into  three  broad  categories  according  to 
the  experimental  manipulation:  robot-related  fac¬ 
tors  (including  performance-based  and  attribute- 
based  factors),  human-related  factors  (including 
ability-based  and  human  characteristic  factors), 
and  environment-related  factors  affecting  trust 


(including  team  collaboration  and  task-based 
factors).  These  differentiates  enabled  a  quanti¬ 
tative  review  of  the  predictive  strength  of  these 
respective  trust  factors  in  human-robot  teams. 
See  Figure  1  for  factors  identified  as  potential 
antecedents  of  human-robot  trust  on  the  basis  of 
the  literature  review  and  SME  guidance. 

The  Calculation  of  Effect  Size 

A  meta-analytic  approach  was  used  to  evalu¬ 
ate  the  data  collected  to  determine  the  pattern  of 
findings  in  the  contemporary  body  of  human- 
robot  trust  research.  First,  each  study’s  effect 
size  was  calculated  using  standard  formulas  (see 
Hedges  &  Olkin,  1985;  Hunter  &  Schmidt, 
2004;  Morris  &  Deshon,  2002).  Studies  included 
in  effect  size  calculation  contained  both  correla¬ 
tional  and  group  design  data;  therefore  the  use 
of  multiple  meta-analytic  methods  (correlation 
and  Cohen’s  d)  was  necessary.  The  correlational 
effects  represent  an  association  between  trust 
and  the  given  factor.  Cohen’s  d  indicates  the 
standard  difference  between  two  means  in  stan¬ 
dard  deviation  units.  From  these,  we  can  gather 
correlational  and  causal  inferences  between 
trust  and  any  given  factor.  Through  both  types 
of  meta-analytic  effects,  the  more  positive  the 
effect,  the  more  trust.  Findings  were  interpreted 
with  the  use  of  Cohen’s  (1988)  established  ranges 
for  small  (d  <  .20;  r  <  .10),  medium  ( d  =  .50; 
r  =  .25),  and  large  ( d  >  .80;  r  >  .40)  effect  sizes. 

Variance  Estimates 

Several  variance  estimates  were  calculated. 
First,  variability  of  the  effect  sizes  themselves 
(,Cj  and  variability  attributable  to  sampling 
error  (.r)  were  estimated.  Next,  these  two  val¬ 
ues  were  used  to  compute  the  residual  variance 
(.v28).  A  large  (s28)  is  an  indication  that  the  effect 
sizes  may  be  heterogeneous  and  therefore  one  or 
more  variables  are  likely  to  be  moderating  the 
magnitude  of  that  particular  effect.  A  final  check 
for  homogeneity  of  variance  ( s2J  .s,2r)  was  calcu¬ 
lated  (proportion  of  total  variance  accounted  for 
by  sampling  error).  Hunter  and  Schmidt  (2004) 
suggest  that  an  outcome  of  0.75  or  greater  sug¬ 
gests  that  the  remaining  variance  is  attributable 
to  a  variable  that  could  not  be  controlled  for  and 
represents  homogeneity  of  variance.  However, 
large  residual  variance  and  small  homogeneity 


Downloaded  from  hfs.sagepub.com  at  University  of  Central  Florida  Libraries  on  November  1 , 201 1 


Trust  and  Hu  man- Robot  Interaction 


521 


f - 

Human-Related 

v. _ 

AB1UTY-8ASE0 

'AttentionalCapacrty/ 

Engagement 

Expertise 

(Amount  of  Training) 
Competency 
Operator  Workload 
Prior  Experiences 
Situation  Awareness 


|  CHARACTERISTICS  | 

♦'Demographics 
'Personalty  Traits 
'Attitudestcwards  Robots 
'Comfort  with  Robot 
Self-confidence 
Propensityto  Trust 
I _ 


r  ■>, 

Robot-Related 

PERFORMANCE-BASED 

♦'Behavior 

'Dependability 

♦'R e l  iabifty  of  Robot 

'Predictability 

'Levei  of  Automation 

Failure  Rates 

FaiseAlarms 

Transparency 

ATTRIBUTE-BASED 

♦Proxi  m  ity/Co-  locano  n 

♦  'Robot  Personality 

♦Adaptabilty 

♦'Robot  Type 

'Anthropomorphism 

e - \ 

Environmental 

s _ 

\  TEAM  COUAflORAnON  | 

'In-group  Membeiship 

♦'Culture  | 

♦'Communication 
Shared  Mental  Models 

TASKING 

|  ♦'Task  Type  | 

|  Task  Complexity  | 

Multi-tasking  Requirement 
PhysicalEnvironment 


Human-Robot  Trust 


Figure  1.  Factors  of  trust  development  in  human-robot  interaction.  These  factors  were  identified  a  priori  via 
literature  review  and  subject  matter  expert  guidance.  Factors  included  in  the  correlational  analysis  are  starred 
(*).  Factors  included  in  the  experimental  analysis  are  crossed  (+). 


of  variance  may  be  seen  because  of  a  small 
number  of  sample  studies,  as  is  evident  in  some 
of  the  following  results  (see  Lipsey  &  Wilson, 
2001,  for  an  in-depth  examination  of  the  vari¬ 
ous  strengths  and  weaknesses  relating  to  meta- 
analytic  procedures). 

RESULTS 

Overall  Outcome  Effects 

Correlational  analysis.  For  the  10  studies 
reporting  correlational  data,  the  present  meta- 
analytic  results  indicated  that  there  was  a  mod¬ 
erate  global  effect  between  trust  and  all  factors 
influencing  HRI  (r  =  +0.26;  see  Table  1).  That 
the  identified  confidence  interval  does  not 
include  zero  confirms  that  this  identified  rela¬ 
tionship  is  consistent  and  substantive.  The 


subsidiary  analysis  between  trust  and  human, 
robot,  and  environmental  factors  individually 
indicated  only  small  effects  for  the  human 
dimensions  (r  =  +0.09)  and  also  the  environ¬ 
mental  characteristics  (f  =  +0.1 1),  and  because 
the  confidence  intervals  for  human  and  envi¬ 
ronmental  factors  included  zero,  our  current 
state  of  knowledge  suggests  that  the  human  and 
the  environment  are  not  strongly  associated  with 
trust  development  in  HRI  at  this  point  in  time. 
We  should,  however,  emphasize  that  these 
results  derive  from  only  a  limited  number  of 
studies  and  thus  may  change  with  future 
evaluations. 

Robot-related  characteristics  were  found  to 
be  moderately  associated  with  trust  in  HRI  (r  = 
+0.24),  in  line  with  the  level  of  the  global  effect. 
Robot  influences  were  able  to  be  parsed  into  two 
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TABLE  1:  Formal  Human-Robot  Trust  Meta-Analysis  Results  With  Correlational  Data:  Global,  Trust 
Factors,  and  Robot  Factors 

Category 

k 

r 

s2r 

S2e 

s2p 

s2  /s2 

e  p 

95%  Cl 

n 

Global 

10 

+.26 

.14 

.01 

.13 

.05 

+.21  <5  <+.31 

1,228 

Trust  factors 

Robot 

8 

+.24 

.21 

.01 

.20 

.05 

+.16  <  5  <  +.31 

882 

Human 

7 

+.09 

.14 

.02 

.13 

.11 

.00  <6  <+.19 

727 

Environment 

4 

+.11 

.11 

.01 

.10 

.08 

+.02  <6  <+.20 

645 

Robot  factors 

Attribute 

5 

+.03 

.08 

.02 

.07 

.22 

-.09  <8  <+.15 

686 

Performance 

5 

+.34 

.43 

.01 

.42 

.03 

+.25  <8  <+.43 

607 

Note,  k  =  number  of  studies;  n  =  sample  size;  s2  estimates  the  variability  of  the  effect  sizes  themselves;  estimates 
the  variability  attributable  to  sampling  error;  s2  is  an  estimate  of  the  residual  variance;  s2/s2)  is  a  calculation  of 
homogeneity  of  variance;  Cl  =  confidence  interval. 


subcategories:  robot  performance-based  factors 
(e.g.,  reliability,  false  alann  rate,  failure  rate)  and 
attribute-based  factors  (e.g.,  proximity,  robot  per¬ 
sonality,  and  anthropomorphism).  With  respect 
to  the  influence  of  the  robot,  it  was  determined 
that  performance  factors  were  more  strongly 
associated  (f  =  +0.34)  with  trust  development 
and  maintenance.  However,  in  contrast,  robot 
attributes  had  only  a  relatively  small  associated 
role  (r  =  +0.03).  Such  potential  influences  for 
human-  and  environmental-related  factors  were 
not  examined,  as  there  were  insufficient  samples 
at  the  present  juncture  to  run  acceptable  quanti¬ 
tative  meta-analytic  procedures. 

Experimental  analysis.  In  contrast  to  studies 
that  presented  correlational  data,  experimental 
studies  reported  group  differences.  Therefore, 
for  this  latter  meta-analysis,  we  used  Cohen’s  d. 
The  results  for  the  meta-analytic  approach  with 
the  use  of  Cohen’s  d  produced  a  similar  pattern  to 
that  for  the  correlational  studies.  These  results, 
shown  in  Table  2,  indicated  there  was  a  large 
global  effect  concerning  trust  and  HRI  (o' =+0.7 1 ). 
As  the  confidence  interval  excluded  zero,  we  can 
assume  this  is  a  substantive  and  consistently 
large  effect.  The  subdivision  of  this  global  effect 
into  robot,  human,  and  environmental  charac¬ 
teristics  indicated  that  the  robot  {d  =  +0.67)  had 
the  greatest  effect.  There  was  a  moderate  effect 
for  environmental  factors  ( d  =  +0.47)  but  only 
very  small  effects  for  human  factors  ( d  =  -0.02). 
Robot  factors  were  again  parsed  into  the  two 


categories  of  attributes  and  performance. 
Robot  performance  factors  (d  —  +0.71)  were  the 
largest  identifiable  influences  on  HRI  trust, 
whereas  robot  attributes  ( d  =  +0.47)  had  a 
smaller  but  still  sizeable  influence  on  trust 
development. 

We  should,  however,  point  out  that  the  perfor¬ 
mance  factors  are  based  on  two  studies,  which 
may  bring  into  question  the  stability  of  the  effect. 
However,  each  study  has  a  sizable  effect  sup¬ 
porting  this  found  effect.  The  attribute  factors 
are  based  on  eight  studies,  pointing  to  stronger 
stability  of  the  effect.  Specific  influential  effects 
for  human-  and  environment-related  factors  were 
not  examined,  as  there  were  insufficient  data  to 
run  the  meta-analysis.  In  all  of  the  aforemen¬ 
tioned  categories  in  which  there  were  sufficient 
data  to  identify  effects,  none  of  the  confidence 
intervals  for  the  experimental  work  included 
zero.  Therefore,  we  can  have  a  degree  of  confi¬ 
dence  that  these  are  each  consistent  and  real 
effects. 

DISCUSSION 

Trust  is  a  crucial  dimension  in  maintaining 
effective  relationships  with  robots.  The  pres¬ 
ence,  growth,  erosion,  and  extinction  of  trust 
have  powerful  and  lasting  effects  on  how  each 
member  of  any  shared  relationship  behaves  and 
will  behave  in  the  future.  Currently,  we  see  tech¬ 
nology  (and  the  present  panoply  of  robots)  as 
largely  insensate  and  without  individual  motive 
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TABLE  2:  Formal  Hu 

Robot  Factors 

man-Robot  Trust  Meta-Analysis  Results  With  Cohen's 

d:  Global,  Trust  Factors,  and 

Category 

k 

d 

s29 

s2e  s28  s2 

e/s2§ 

95%  Cl 

n 

Global 

11 

+.71 

.26 

.09  .16 

.36 

+.53  <  6  <+.89 

1,567 

Trust  factors 

Robot 

8 

+.67 

.15 

.07  .08 

.48 

+.48  <  5  <  +.85 

1,119 

Human 

2 

-.02 

g  =  +.01  (Kidd,  2003);  g  =-.88 

202 

(Scopelliti,  Giuliani,  &  Fornana,  2005) 

Environment 

5 

+.47 

.21 

.07  .13 

.36 

+.23  <§<+.71 

609 

Robot  factors 

Attribute 

8 

+.47 

.25 

.07  .19 

.27 

+.28  <  §  <  +.65 

1,119 

Performance 

2 

+.71 

g  =  +.71  (Ross,  2008);  g  = +.74 

554 

(Tsui,  Desai,  &  Yanco,  2010) 

Note,  k  =  number  of  studies;  n  =  sample  size;  s2  estimates  the  variability  of  the  effect  sizes  themselves; 

estimates  the  variability  attributable  to  sampling  error;  s28  is  an  estimate  of  the  residual  variance;  s2/s|  is  a 
calculation  of  homogeneity  of  variance;  Cl  =  confidence  interval. 


force.  Although  we  are  often  frustrated  with  tech¬ 
nological  shortcomings  and  failures  and  express 
our  frustration  accordingly,  at  heart,  we  know  we 
are  dealing  with  the  residual  effects  of  a  remote 
human  designer.  However,  we  stand  on  the  verge 
of  a  sufficiently  impactful  change  that  our  attri¬ 
bution  of  intentionality  to  all  technology  will  soon 
be  justified  (and  see  Epley,  Waytz,  &  Cacioppo, 
2007;  Moravec,  1988).  At  this  juncture,  the  issue 
of  trust  in  technological  systems  will  be  as  influ¬ 
ential  on  social  development  as  it  is  in  our  own 
human-human  relationships. 

Trust  is  only  one  of  a  number  of  critical  ele¬ 
ments  essential  to  human-robot  collaboration,  but 
it  continues  to  be  a  growing  concern  as  robots 
advance  in  their  functionality.  This  is  especially 
the  case  in  military  and  emergency  contexts  in 
which  a  warfighter’s  or  an  operator’s  own  life 
and  the  lives  and  safety  of  others  depend  on 
successful  interaction.  The  present  research 
represents  one  of  the  first  systematic  efforts 
to  quantify  effects  concerning  human  trust  in 
robots.  Our  results  reveal  that  robot  character¬ 
istics,  and  in  particular,  performance-based 
factors,  are  the  largest  current  influence  on 
perceived  trust  in  HRI.  These  findings  imply 
that  manipulating  different  aspects  of  the 
robot’s  performance  influences  trust  the  most. 
This  finding  is  central  to  the  consideration  of 
coming  robot  design.  Trends  in  the  literature 


indicate  that  higher  trust  is  associated  with  higher 
reliability  (for  example,  see  Ross,  2008). 
Furthermore,  the  type,  size,  proximity,  and 
behavior  of  the  robot  also  affect  trust  (for  exam¬ 
ples,  see  Bainbridge,  Hart,  Kim,  &  Scassellati, 
2008;  Tsui,  Desai,  &  Yanco,  2010).  Taking  such 
factors  into  consideration  can  have  meaningful 
influence  on  future  robot  design  and  associated 
human-robot  interaction,  although  further  research 
is  still  needed  to  develop  specific  design  heuristics. 

Environmental  factors  were  also  found  to 
be  moderately  influential  on  trust  development. 
Team  collaboration  characteristics  and  tasking 
factors,  as  identified  by  SMEs  and  in  the  literature 
itself,  were  included  in  this  analysis.  However,  fur¬ 
ther  specification  of  team-related  and  task-related 
effects  could  not  be  drawn  because  of  the  insuf¬ 
ficient  number  of  empirically  codable  studies. 
Limited  evidence  for  human-related  factors  was 
found.  The  present  findings,  however,  should 
not  be  taken  to  imply  that  human  characteristics 
in  HRI  are  not  necessarily  important.  Rather,  the 
small  number  of  studies  found  in  this  area 
suggests  a  strong  need  for  future  experimental 
efforts  on  human-related,  as  well  as  environment- 
related,  factors. 

Although  human-automation  interaction  in 
general  has  been  researched  in  more  depth 
(Dzindolet,  Peterson,  Pomranky,  Pierce,  &  Beck, 
2003;  Lee  &  See,  2004;  Madhavan  &  Wiegmann, 
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2007;  Sheridan,  2002;  Sheridan  &  Parasuraman, 
2006),  sparse  empirical  research  has  been  con¬ 
ducted  in  a  number  of  specific  and  important 
areas  associated  with  human-robot  trust.  For 
instance,  as  noted,  there  is  a  dearth  of  studies  on 
the  human-related  characteristics,  including  prior 
level  of  operational  experience,  attentional 
capability,  the  amount  of  training  received,  self- 
confidence,  the  propensity  to  trust,  existing  atti¬ 
tudes  toward  robots,  personality  traits,  operator 
workload,  situation  awareness,  and  other  individ¬ 
ual  difference  factors  (see  Flancock,  Flancock,  & 
Warm,  2009).  Gaps  in  the  understanding  of  the 
various  environmental  characteristics  include 
culture  (of  the  team,  the  individual,  and  the  ambi¬ 
ent  environment),  shared  mental  models,  multi¬ 
tasking  requirements,  task  complexity,  and  task 
type.  We  also  have  limited  empirical  evidence 
on  the  effects  of  robot  “false”  alarms.  Resolution 
in  these  areas  is  crucial  to  provide  an  increasing 
depth  of  understanding  on  trust  in  FIRI. 

Our  meta-analytic  findings  have  implications 
for  both  research  and  practice,  hi  terms  of  research, 
as  we  build  functional  models  of  HRI,  we  will 
need  to  understand  and  quantify  the  various 
influences  and  derive  information  on  factors  we 
have  shown  that,  to  date,  are  completely  miss¬ 
ing.  Without  a  larger  and  active  empirical  attack, 
our  knowledge  will  remain  precarious  and  based 
often  on  either  anecdotal  or  engineering-centered 
case  studies.  With  regard  to  practical  implica¬ 
tions,  the  major  lesson  learned  is  that  a  robot’s 
performance  and  attributes  should  be  consid¬ 
ered  the  primary  drivers  of  trust.  Understanding 
exactly  how  these  factors  affect  the  develop¬ 
ment  of  trust  will  be  critical  for  trust  calibration. 
For  example,  we  are  aware  of,  and  have  cited  one 
instance  of,  a  number  of  occasions  in  the  military 
in  which  robots  have  looked  to  be  deployed,  but 
because  of  the  intrinsic  trust  question,  they 
have  never  been  taken  “out  of  the  box”  (often 
because  of  a  bad  reputation  preceding  the  sys¬ 
tem  or  its  perceived  complexity  of  operation). 
Consequently,  if  the  perceived  risk  of  using  the 
robot  exceeds  its  perceived  benefit,  practical 
operators  almost  always  eschew  its  use.  Flence, 
training  that  encourages  trust  in  specific  robots 
is  necessary  from  the  point  of  design  inception 
on,  until  its  eventual  field  use. 


The  implications  of  this  research  can  also  be 
applied  to  trust  in  FIRI  in  a  number  of  critical 
areas  outside  of  the  military.  These  include,  espe¬ 
cially,  considerations  in  the  medical  and  health 
care  arenas.  Assistive  robotic  technologies  are 
also  being  developed  and  tested  for  mobility  pur¬ 
poses,  rehabilitation,  and  of  course,  surgical  aids 
(Tsui  &  Yanco,  2007).  Social  robots  for  domestic 
use  are  also  being  designed  to  help  people  with 
cognitive  and  physical  challenges  maintain  a  high 
quality  of  life  (Heerink,  et  al.,  2010).  For  exam¬ 
ple,  the  Care-O-Bot  II  is  a  robotic  home  assistant 
that  was  created  to  support  the  needs  of  elderly 
persons  in  private  homes,  allowing  individuals 
greater  independence  without  the  necessary 
presence  of  a  human  caregiver  (Graf,  Hans,  & 
Schraft,  2004). 

Other  robotic  devices,  such  as  wheelchairs 
(Yanco,  2001)  and  exoskeletons  (e.g.,  robotic 
arms,  legs;  Guizzo  &  Goldstein,  2005)  can 
benefit  disabled  individuals  by  enhancing  their 
remaining  physical  capabilities.  Furthermore, 
robots  are  capable  of  telepresence  in  life- 
threatening  situations  when  medical  profession¬ 
als  cannot  be  physically  present  as  well  as  in 
cases  involving  high  risk,  such  as  search-and- 
rescue  operations  (Murphy,  Riddle,  &  Rasmussen, 
2004)  and  repairs  in  contaminated  conditions,  as 
the  recent  Japanese  nuclear  power  plant  experi¬ 
ence  has  shown  (Glionna  &  Nagano,  2011).  Given 
our  current  meta-analytic  findings,  robot  perfor¬ 
mance  factors  in  these  domains  are  also  therefore 
most  critical  to  consider.  Regardless  of  context, 
a  user  must  trust  the  robot  to  enable  effective 
interaction. 

Future  Research 

The  type  of  trust  measure  used  is  relevant 
to  the  present  conclusions.  Our  meta-analysis 
found  that  current  trust  in  HRI  is  derived  almost 
exclusively  via  subjective  response,  measured 
one  time  after  a  specific  interaction.  However, 
physiological  indicators,  such  as  oxytocin-related 
measures,  and  objective  measures,  such  as  trust 
games  that  assess  actual  investment  behavior, 
are  used  frequently  in  the  human-interpersonal 
trust  literature  (for  examples,  see  Chang,  Doll, 
van ’t  Wout,  Frank,  &  Sanfey,  2010;  Keri,  Kiss, 
&  Kelemen,  2009).  These  measures  should  be 
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explored  in  the  context  of  human-robot  trust  to 
augment  the  present  perceptual  assessments  and 
identify  potential  inconsistencies  between  such 
measures.  Discrepancies  between  an  individual’s 
self-report  (i.e.,  perception)  and  his  or  her  behavior 
(i.e.,  observable  reaction)  is  an  issue  that  has  been 
a  topic  of  concern  in  psychology,  and  especially 
applied  psychology,  for  a  number  of  decades  (see 
Hancock,  1 996;  Natsoulas,  1 967).  An  individual 
can  report  that  he  (or  she)  will  trust  a  robot,  but 
existing  research  leads  us  to  believe  that  this 
statement-action  relationship  is  not  always  per¬ 
fect  (Chen  &  Terrence,  2009).  Therefore,  empir¬ 
ical  research  that  includes  both  subjective  and 
objective  measurements  can  provide  a  more 
complete  portraiture  of  the  genesis  and  persis¬ 
tence  of  trust. 

A  comparison  of  perceptions  and  actual  robot 
capabilities  is  also  needed.  Each  person  in  a  team 
can  have  differing  perceptions  of  the  intent,  per¬ 
formance,  and  actions  of  a  robotic  entity,  but 
indeed,  these  perceptions  may  not  all  match  the 
true  capabilities  of  the  robot.  These  differences 
in  perception  may  be  mitigated  to  an  extent  by 
employing  training  methods  that  adequately  pre¬ 
pare  an  individual  for  the  coming  interaction.  In 
summary,  numerous  avenues  of  research  need  to 
be  pursued  to  fully  comprehend  the  role  that  trust 
plays  in  HRI  as  well  as  the  factors  that  influence 
trust  in  robots  themselves  as  stand-alone  entities. 
Even  so,  our  current  findings  indicate  that  cur¬ 
rently,  the  most  important  element  of  trust  is  robot 
related.  Fortunately,  these  factors  (e.g.,  robot  per¬ 
formance,  robot  attributes)  can  be  directly  manip¬ 
ulated  by  designers  (with  the  constraints  of 
technological  capabilities).  In  this  way,  we  are 
able  to  predict  to  some  degree  the  development 
of  trust  in  human-robot  partnerships  in  existing 
systems. 
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KEY  POINTS 

•  The  meta-analytic  procedures  included  10  refer¬ 
ences  for  correlational  analysis  (yielding  69  cor¬ 
relational  effect  sizes)  and  1 1  for  experimental 
analysis  (yielding  47  experimental  effect  sizes). 

•  Robot  characteristics,  and  in  particular,  robot  per¬ 
formance,  were  found  to  be  the  most  important 
influences  of  trust  development. 

•  Environmental  factors  moderately  influenced 
trust,  whereas  little  evidence  was  found  for  the 
effect  of  human  characteristics  on  trust  in  human- 
robot  interaction  (HRI). 

•  Although  human  dimensions  played  a  small  role 
in  trust  development,  the  lack  of  findings  may 
be  attributable  to  insufficient  empirical  data 
(suggesting  limitations  in  the  research),  which 
should  be  addressed  in  future  experimentation. 

•  The  current  summary  of  findings  emphasizes  the 
importance  of  focusing  on  robot-related  factors  in 
design  and  training  guidelines  for  HRI. 
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